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SUMMARY 

This  technical  report  documents  the  development  of  a  Monte  Carlo 
simulation  of  the  observer  model.  Luenberger  reduced -order  observer 
theory  has  been  used  to  develop  a  mathematical  representation  of  the 
anti-aircraft-artillery  (AAA)  manned  tracking  system.  Previous  reports 
show  the  excellent  predictive  property  of  this  modeling  structure.  The 
original  model  outputs  were  the  ensemble  mean  and  standard  deviation  of 
the  tracking  error.  Because  some  existing  weapon  system  attrition  models 
have  resorted  to  Monte  Carlo  methods  it  became  necessary  to  develop 
a  compatible  simulation  of  the  observer  model. 

The  development  of  the  simulation  equations  and  a  detailed  descrip¬ 
tion  of  the  statistical  properties  of  the  remnant  element  are  given  in 
the  report  along  with  computer  program  flow  chart  and  code.  It  is 
necessary  that  the  sample  ensemble  of  many  single  Monte  Carlo  time 
histories  converge  to  the  ensemble  mean  prediction  of  the  observer 
model.  Program  outputs  depicting  the  sample  ensemble  for  a  wide  range 
of  sample  sizes  are  included  which  show  the  excellent  convergence  of 
the  Monte  Carlo  simulation  to  the  ensemble  mean  prediction.  Simulation 
results  verify  that  the  Monte  Carlo  simulation  of  the  observer  model 
can  be  used  with  confidence  in  AAA  System  Attrition  Analysis. 

An  important  application  of  the  Monte  Carlo  simulation  is  the 
analysis  of  empirical  data  sample  size  requirements.  Now  that  observer 
model  parameters  are  identified  directly  from  the  empirical  data  it  is 
necessary  to  determine  the  sensitivity  of  the  algorithms.  Monte  Carlo 
simulation  outputs  are  used  as  a  reference  in  the  curve-fitting  programs 
to  determine  a^good  trade-off  between  the  cost  of  large  sample  sizes  and 
the  high  statistical  variability  of  low  sample  sizes. 
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Section  I 
INTRODUCTION 

Luenberger  reduced-order  observer  theory  has  been  used  to  develop 
a  mathematical  representation  of  the  anti-aircraft-artillery  (AAA) 
gunner's  response  in  a  compensatory  tracking  task.  This  model  is 
described  in  detail  in  other  references  [1],  [2].  The  observer  concept 
of  state  estimation  combined  with  linear  state  variable  feedback  and  a 
remnant  element  provides  a  simple  and  computationally  efficient 
representation  of  the  human’s  control  characteristics.  A  parameter 
identification  program  based  on  the  least  squares  curve-fitting  method 
and  the  Gauss  Newton  gradient  algorithm  eliminates  the  need  for  parameter 
tuning  and  other  trial  and  error  procedures.  For  reference,  a  brief 
description  of  the  AAA  gun  system  and  model  configuration  follows. 

The  basic  task  of  the  AAA  gunner  is  to  minimize  the  error  in 
azimuth  and  elevation  between  the  weapon  system  gunsight  and  the  target. 

The  error  is  displayed  on  an  optical  sight  and  alignment  is  induced  by  a 
handcrank  control  with  rate  dynamics.  Fundamental  variables  are  shown 
in  the  closed  loop  block  diagram  of  Figure  1. 

The  elements  of  the  observer  model  are  shown  in  the  block  diagram 
of  Figure  2.  An  observer  provides  an  estimate  of  the  states  of  the  AAA 
System  from  the  visually  observed  tracking  error.  A  linear  state  variable 
feedback  control  law  based  on  the  estimated  states  represents  the  gunner's 
control  output.  Sources  of  randomness  such  as  modeling  error,  observa¬ 
tion  error,  neuromotor  noise,  etc.  are  lumped  into  one  element  called  remnant. 

Computer  simulation  results  of  the  closed  loop  AAA  tracking  task 
with  the  previously  described  gunner  model  are  the  ensemble  mean  and 
standard  deviation  of  tracking  error.  The  purpose  of  this  paper  is  to 
describe  the  details  of  the  Monte  Carlo  simulation  of  an  AAA  System 
using  the  observer  model.  The  output  of  this  model  is  a  single  time 
history  of  tracking  error. 
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Figure  1.  Block  Diagram  of  an  AAA  Closed  Loop  System 


Diagram  of  Observer  Model  Structure 


Motivation  for  development  of  this  simulation  arose  primarily 
from  requirements  imposed  by  overall  AAA  System  attrition  modeling. 

The  gunner  model  is  incorporated  into  a  large  scale  attrition  model  and 
therefore  must  be  compatible  in  structure.  Some  existing  attrition 
programs  have  resorted  to  Monte  Carlo  methods  because  of  the  need  to 
simulate  nonlinear  elements  and  integrate  diverse  weapon  system 
functions.  The  statistics  of  required  system  variables  can  thus  be 
determined  easily  by  obtaining  the  sample  ensemble  of  a  large  number  of 
single  Monte  Carlo  runs. 

Results  from  the  Monte  Carlo  simulation  of  the  observer  model  have 
been  applied  in  a  parameter  identification  sensitivity  analysis.  Now 
that  computer  programs  are  available  to  identify  model  parameters,  it 
is  essential  to  know  empirical  data  sample  sizes  necessary  for  consistent 
results.  A  sample  size  that  is  too  small  will  give  large  variability 
in  the  estimated  parameters  while  an  excessively  large  sample  size  is 
expensive  from  the  standpoint  of  experimentation  cost.  The  least 
squares  curve-fitting  identification  program  fits  the  ensemble  mean  and 
standard  deviation  of  model  predictions  of  tracking  errors  to  the  sample 
ensemble  mean  and  standard  deviation  of  the  empirical  data.  The 
ensembled  Monte  Carlo  model  predictions  were  used  as  input  data  to  the 
identification  algorithms  for  this  purpose.  Identification  results 
for  a  wide  number  of  sample  sizes  are  presented. 
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Section  II 

MONTE  CARLO  SIMULATION  EQUATIONS 


A.  System  Equations 

The  dynamics  of  the  anti-aircraft-artillery  gunsight  and 
target  motion  are  given  by  the  following  system  equations: 

x  =  Ax  +  Bu  +  f'0_ 

—  —  T 

where  x  is  the  state  vector 


representing  the  tracking  error  and  the  target  velocity. 
The  system  matrices  are: 


The  tracking  error  is  displayed  to  the  gunner  and  is  given  by 
the  measurement  equation-’ 


y  =  Cx 
C  =  [1  0] 
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Now,  the  system  equations  are  used  to  design  the  gunner  model. 
Since  the  tracking  error  is  available  through  direct  observation,  a 
Luenberger  reduced-order  observer  can  be  used  to  obtain  an  estimate 

of  the  remaining  state,  i.e.,  x  . 

2 

The  control  law  is  subsequently  expressed  as 


u  =  uc  +  v 

Where  v  is  a  zero  mean  Gaussian  white  noise  which  represents 
the  remnant. 

Finally,  it  can  be  shown  that  the  closed  loop  system  (gunsight 
dynamics,  target  motion,  and  gunner  model)  is  given  by  the  following 
equations 

x  =  Ax  +  F9_,  +  Dv 

—  1—  l  T  j 


Where  x  is  the  tracking  error  y, 

1  • 

x  is  defined  as  0-r-  -  ky,  and 
2  .  " 

x  is  defined  as  0T  -  x„. 

3  T  2 
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And 


A 

l 


a  +a  k  -  b  (y  +  ky  ) 
u  12  11  2 
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i 

1 

F  = 

f  -  kf 

D  = 

b  -  kb 

l 

2  i 

1 

2  1 

f  -  kf 

b  -  kb 

L  2  1  J 

L  2  .  1  J 

The  control  gains  y  ,  y  and  the  observer  gain  k  are  obtained  by  the 
1  2 

parameter  identification  program  [Refs.  (1),  (2)]. 

B.  Mathematical  Description  of  Remnant  Element 

The  remnant  element  v  represents  human  psychophysical  limitations 
and  modeling  error.  Its  statistical  properties  are  given  by, 

E[v(t) ]  =  0  V  t 

E[v(t)v(T)]  =  q (t)6 (t  -  t) 

Where  q(t)  is  the  covariance  function  and  6(t)  is  the  Dirac  delta 
function. 
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Analysis  of  empirical  data  indicates  that  the  standard  deviation 
of  the  tracking  error  is  due  predominantly  to  the  gunner's  uncertainty 
in  target  motion.  Thus  the  covariance  function  can  be  generalized  in 
the  following  form: 

q(t)  =  a  +  a  0*(t)  +  a  0*(t) 

1  2  T  3  i 

Where  a  ,  a  ,  a  are  nonnegative  constants  to  be  determined  by 
1  2  3 

the  curve  fitting  algorithm  [Ref.  (2)]. 
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Section  III 

DESCRIPTION  OF  COMPUTER  SIMULATION 

A.  Generation  of  Random  Noise  Sequence 

The  closed  loop  system  equations  are  discretized  for  convenient 
implementation  on  the  digital  computer.  Thus  a  random  noise  sequence 
representing  the  remnant  element  must  be  generated  possessing  the  given 
statistical  properties.  In  discrete  time,  the  standard  deviation  of 
the  zero  mean  sequence  is  given  by, 

rq(tk)-|l/2 

v‘k> '  Ira"  J  "*> 

where  q(t^)  is  defined  as  follows: 

A 

q(tfc)  =  aj  +  a2^(tk)  +  a3'6T(tk> 

Also,  Del  is  the  sampling  period  of  the  discretization  process  and, 
n(k)  =  N(0,1) 

is  a  unit  variance,  zero  mean,  Gaussian  random  variable. 

In  the  computer  program,  n(k)  is  generated  by  averaging  12  uniformly 
distributed  (-1/2,  +1/2)  independent  random  variables.  The  statistical 
properties  of  r| (k)  were  checked  and  are  given  by  Table  1.  For  a  100 
point  sample  the  convergence  is  approximately  within  five  percent. 
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TABLE  1.  STATISTICAL  PROPERTIES  OF  n(k) 


Number  of  Points 

Mean 

Standard  Deviation 

16 

.36354 

.93692 

100 

. 04054 

.95703 

500 

.025437 

.96013 

1000 

.0082841 

.96165 

2000 

-.0027901 

.96326 

10000 

-.00028009 

.98910 

B.  Flow  Chart  of  Computer  Program 

The  computer  program  for  the  Monte  Carlo  simulation  was  based  on 
the  original  reduced-order  observer  model  program  that  generates  the 
mean  and  standard  deviation  of  tracking  error  [Refs.  (1),  (2)]. 
Necessary  changes  were  made  to  solve  the  actual  closed  loop  system 
equations  rather  than  the  expected  value  form.  Code  is  also  included 
to  generate  the  random  noise  sequence.  A  flow  chart  of  the  Monte 
Carlo  Computer  Program  is  given  in  Figure  3.  The  Fortran  IV  code  is 
listed  in  Figure  4. 
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Figure  3.  Flow  Chart  of  Simulation  Program 
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Figure  4.  Fortran  IV  Computer  Program  for  the  Monte  Carlo 
Simulation 
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CALL  PHIL  I  W 1  ?  X  N  »  N  I.  *  W2  • 

DO  40  I  =  1 1 N  :l 
40  X<l)--A<l>*v+U2<  i:  > 

SD®SQRT v  X ( 1 » 1 )  > 

DO  95  I ® 1 f  N 

n=i 

W3 ( 3  )  =  0 . 0 

DO  90  J®1 r Nl r N 

W3(I)®W3<I)iLIHI)*Y(i:i> 

90  u==im 

95  CONTINUE 

DO  100  1=1 f N 

Y  < I ) ®W3 < I ) +R 1 v  I ) #P <  i  r 1 C > I R2 ( I > tUK 

.1.00  CONTINUE 

T=T+DEL 

LK®<  1 1.001 )/. DEL 
I F <  MOD <  LK  ? 25 ) . ME . 0 ) GO  TO  48 
PR I NT 75 » T • Y ( 1 > 

75  FORMAT <5X? 2012. 4- 

WR  I  TE  <  8  •>  24  )  T  ■  Y-.  I.  • 


Figure  4. 


Fortran  IV  Computer  Program 
Simulation  (cont.) 


for  the  Monte  Carlo 
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Figure  4.  Fortran  IV  Computer  Program  for  the  Monte  Carlo 
Simulation  (cont.) 
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Section  IV 
SIMULATION  RESULTS 


Outputs  from  the  Monte  Carlo  simulation  are  presented.  Figures  5 
and  6  show  the  ensemble  mean  and  standard  deviation  of  tracking  errors 
for  a  typical  flyby  trajectory  as  predicted  by  the  standard  reduced-order 
observer  model,  [Ref.  (2)].  These  results  are  in  excellent  agreement  with 
actual  gunner  response  data  obtained  from  manned  AAA  simulator  experiments 
conducted  at  the  Aerospace  Medical  Research  Laboratory,  WPAFB,  Ohio 
[Ref.  (2)]. 

It  is  necessary  that  the  sample  ensemble  of  many  Monte  Carlo  runs 
agree  with  the  output  from  the  ensemble  mean  and  standard  deviation 
observer  model.  A  computer  program  was  developed  to  obtain  the  sample 
ensemble  and  standard  deviation  of  N  single  Monte  Carlo  time  histories 
to  check  this  convergence.  The  same  model  parameter  values  were  used  in 
both  computer  simulations.  For  reference  a  single  Monte  Carlo  sample 
path  is  shown  in  Figure  7.  This  shows  the  fine  structure  of  the  tracking 
error.  The  sample  ensemble  and  standard  deviation  of  tracking  error  for 
sample  sizes  from  n  =  16  to  n  =  100  Monte  Carlo  runs  is  shown  in 
Figures  8  through  27. 

Note  the  high  degree  of  variability  for  a  sample  size  of  16  runs. 
Comparison  with  the  ensemble  mean  model  prediction  of  Figures  5  and  6, 
however,  shows  good  overall  agreement.  An  examination  of  Figures  8 
through  27  indicates  a  steady  improvement  in  the  smoothness  of  the  data 
as  the  sample  size  is  increased.  The  sample  ensemble  of  100  runs  produces 
a  very  smooth  output  highly  correlated  with  the  ensemble  mean  value 
model  prediction. 

Finally,  a  comparison  of  Monte  Carlo  simulations  of  the  observer 
model  and  the  optimal  control  model  is  made.  Figures  28  and  29  show 
the  sample  ensemble  of  100  Monte  Carlo  runs  of  the  optimal  control 
model  for  the  same  trajectory  as  was  used  for  the  observer  model. 

Although  some  differences  in  model  outputs  are  evident,  the  overall 
appearance  of  the  results  from  the  two  models  is  comparable. 
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Section  V 


APPLICATION  OF  MONTE  CARLO  SIMULATION  RESULTS  TO  OBSERVER  MODEL 
PARAMETER  IDENTIFICATION  SENSITIVITY  ANALYSIS 


An  Important  application  of  the  Monte  Carlo  simulation  is  in  the 
analysis  of  empirical  data  sample  size  requirements.  Now  that  parameter 
identification  is  performed  directly  from  the  empirical  tracking  data, 
it  is  necessary  to  determine  the  sensitivity  of  the  algorithms.  The 
sample  ensemble  of  individual  Monte  Carlo  simulation  outputs  will  be 
used  as  a  reference  to  select  the  empirical  data  sample  size.  This  is 
a  valid  approach  since  it  has  been  shown  that  the  Monte  Carlo  predictions 
are  in  very  good  agreement  with  the  empirical  tracking  error  data. 

A  description  of  the  ensemble  mean  and  standard  deviation  observer 
model  parameter  identification  programs  is  given  in  detail  in  Refs.  (1), 
(2).  The  sample  ensemble  of  Monte  Carlo  predictions  for  n  =  10  to  n  =  100 
in  increments  of  10  runs  were  each  used  as  input  data  to  the  mean  parameter 
identification  program.  (Same  flyby  trajectory  as  mentioned  previously 
in  the  report).  The  resultant  parameter  values  and  curve  fitting  cost 
functional  (JMIN)  are  given  in  Table  2.  Parameter  values  are  determined 
iteratively  by  minimizing  the  following: 

rh  2 

J  =J  (eT  -  e^,(t,ot))dt 


where , 


eT(t)  =  mean  input  tracking  error  data 
e^,(t ,a)  =  predicted  mean  tracking  error 

And,  a  is  the  parameter  vector  of  interest.  JMIN  is  the  final 
value  of  the  cost  functional  following  completion  of  the  iteration  process. 
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JMIN  as  a  function  of  sample  size  is  plotted  in  Figure  30.  From 
Figure  30  it  can  be  seen  that  considerable  improvements  in  fit  occur  as 
the  sample  size  is  increased  to  around  40  or  50  runs.  Improvements 
become  asymptotically  smaller  with  even  larger  sample  sizes.  This  result 
indicates  that  a  minimum  sample  of  about  40  or  50  runs  is  required  for 
good  parameter  identification  convergence  properties. 


TABLE  2.  EFFECT  OF  SAMPLE  SIZE  ON  OBSERVER  MODEL  PARAMETER 
IDENTIFICATION  SENSITIVITY 


NUMBER  OF  RUNS 

OBSERVER  GAIN 

CONTROLLER  GAIN 

JMIN 

n 

k 

X 

10 

2.90 

-2.90 

1.77 

20 

2.87 

-2.88 

.902 

30 

2.73 

-2.60 

1.10 

40 

2.88 

-2.89 

.460 

50 

2.83 

-2.69 

.553 

60 

2.83 

-2.80 

.450 

70 

2.85 

-2.79 

.390 

80 

2.86 

-2.80 

.323 

90 

2.87 

-2.81 

.279 

100 

2.87 

-2.90 

.205 

A  similar  study  has  been  conducted  using  the  standard  deviation 
model  parameter  identification  program.  Figure  31  is  a  plot  of  JMIN 
versus  sample  size  using  the  Monte  Carlo  simulation  standard  deviation 
results  as  input  data.  This  graph  also  indicates  that  maximum 
improvement  in  the  curve  fitting  cost  functional  is  obtained  as  the 
number  of  ensembled  runs  is  increased  to  50  approximately.  The  above 
results  were  verified  for  both  the  mean  and  standard  deviation  identifi¬ 
cation  programs  using  simulation  data  from  another  flyby  trajectory. 
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Section  VI 
CONCLUSION 


Comparison  of  the  sample  ensemble  of  many  Monte  Carlo  runs  shows 
excellent  agreement  with  the  ensemble  mean  and  standard  deviation 
model  outputs.  The  statistics  converge  especially  well  for  n  =  100 
runs  as  the  figures  show.  These  results  verify  the  validity  of  this 
simulation  approach  and  computer  program. 

The  Monte  Carlo  simulation  of  the  observer  model  can  be  used  with 
confidence  in  overall  AAA  system  attrition  analysis.  Outputs  from  this 
human  operator  simulation  can  be  readily  integrated  with  other  Monte 
Carlo  anti-aircraft-artillery  system  components.  The  convergence  analyses 
conducted  herein  indicate  the  number  of  runs  necessary  to  obtain  desired 
fidelity  in  the  final  attrition  estimates. 

Similation  results  have  also  been  applied  to  study  the  sensitivity 
of  the  observer  model  parameter  identification  programs.  Analyses 
indicate  that  a  sample  size  of  40  to  50  runs  gives  good  fidelity  in  the 
curve  fitting  programs.  This  information  will  be  used  in  the  design  of 
tracking  experiments  that  generate  data  for  modeling  purposes. 
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